This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHTBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: — " ' 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the imar 
problems checked, please do not report these probler" 

;e 1 


(19) 


J 


Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 


(11) 


EP0 858 212 A1 


(12) 


EUROPEAN PATENT APPLICATION 


/a n\ 

(43) 

Date of publication: 

(51) Int CI e : H04N 3/15 


12.08.1998 Bulletin 1998/33 

(21) 

Application number: 98870024.1 


(22) 

Date of filing: 06.02.1998 



ucoi yi idicu wui i u doiii ly oiaico. 

l~7*y\ ln\/fir»tore" 

\l C-) II IVCl llUlO. 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 

• Dierickx, Bart 


NL PT SE 

IVIUl loci |DC] 


Designated Extension States: 

• Scheffer, Danny 


AL LT LV MK RO SI 

4567 DG Clinge(NL) 

(30) 

Priority: 10.02.1997 US 37531 P 

(74) Representative: Van Malderen, Joelle et al 


04.06.1997 EP 97870084 

Office Van Malderen, 


22.09.1997 EP 97870142 

Place Reine Fabiola 6/1 


24.10.1997 EP 97870169 

1083 Bruxelles (BE) 

(71) 

Applicant: INTERUNIVERSITAIR 



MICRO-ELEKTRONICA CENTRUM VZW 



3001 Heverlee (BE) 



(54) Method for obtaining a high dynamic range read-out signal of a CMOS-based pixel structure 
and such CMOS-based pixel structure 


(57) - A method is disclosed for obtaining a read-out 
signal of a MOS-based pixel structure having at least a 
photosensitive element with an output node and a mem- 
ory element with a first switch therebetween. The meth- 
od comprises the steps of while acquiring charge carri- 
ers on said output node of said photosensitive element, 
said charge carriers being converted from electromag- 
netic radiation on the photosensitive element, after a 
first time period creating a first signal, and after a second 
time period, creating a second signal, said read-out sig- 
nal being a combination of at least said first and said 
second signals. 


According to the present invention, there is no lim- 
itation to the amount of collected charges in none of the 
integrated periods. The signal collected during the first 
period is memorized by a switch which shortly opens 
and closes between the period. The switch is thus in the 
same state in both period of time. After a second period, 
there are thus two charge packets, each obtained during 
a different time. In order to read-out, these two charge 
packets are then combined into one reading. This com- 
bination is known either by adding or subtracting this 
charge packets e. g. by adding or subtracting them in the 
circuitry external to the sensor. 
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Description 

Field of the Invention 

The present invention relates to solid state imaging 
devices being manufactured in a CMOS- or MOS-tech- 
nology. More particularly, the present invention is relat- 
ed to a method of obtaining a read-out signal of a 
CMOS-based pixel structure with a large dynamic 
range. 

The present invention is also related to a new pixel 
structure and to imaging devices having such pixel 
structure involved in the method of the present inven- 
tion. 

Background of the invention and problem definition 

Solid state imaging devices are well known. These 
devices find a widespread use in camera systems. In 
such application, a matrix of pixels comprising light sen- 
sitive elements constitutes an image sensor, which is 
mounted in the camera system. The signal of said matrix 
is measured and multiplexed to a video-signal. 

Commonly solid state image devices are imple- 
mented in a CCD-technology or in a CMOS- or MOS- 
technology. 

Among the image sensors implemented in a 
CMOS- or MOS-technology, CMOS or MOS image sen- 
sors with passive pixels and CMOS or MOS image sen- 
sors with active pixels are distinguished. An active pixel 
is configured with means integrated in the pixel to am- 
plify the charge that is collected on the light sensitive 
element. Passive pixels do not have said means and 
require a charge-sensitive amplifierthat is not integrated 
in the pixel and is connected with a long line towards the 
pixel. 

There is an ongoing effort to increase the perform- 
ance of CMOS or MOS image sensors such that a com- 
parable image quality is obtained as the one obtained 
with high end CCD imagers. Due to the miniaturisation 
of the technology of CMOS based electronic circuits, it 
is further possible to realise complex CMOS- or MOS- 
based pixels as small as CCD-based pixels. It is a main 
advantage of CMOS- or MOS-based image sensors that 
CMOS technology is being offered by most foundries 
whereas CCD-technology is rarely offered and a more 
complex and expensive technology option. 

In the co-pending patent applications EP-A- 
0773667 and EP-97870084.7 pixel structures and 
methods of addressing them are described which yield, 
alone or in combination, the above-mentioned goals. 
The contents of these patent applications are incorpo- 
rated herein by reference. 

In general, it must be recognised that for an imaging 
device, three specifications that are difficult to match are 
to be met: 

the sensitivity of the image device, especially in the 


dark, 

the cosmetic quality of the image (this means that 
the image should be flawless), and 
- the requirement of a response with a high dynamic 
s range. 

Image sensors having a non-linear response such 
as a logarithmic response are known from, e.g. EP-A- 
0739039. 

However, most of the image sensors with passive 
or active pixels show a linear voltage-to-light response. 
This means that their dynamic range is limited by the 
dynamic range of the linear response. For instance, if 
the linear output voltage has an S/R ratio of about 250 
(which is a typical value) the corresponding dynamic 
range will be the same. 

Image sensors with a double linear response or 
multiple linear response are known. In such sensors, 
two or more linear pieces of optical response are com- 
bined in one electrical output signal, outside the pixel. 
Presently, the classical image sensors can be used to 
obtain such double linear response image by capturing 
two images with different sensitivity and combining 
them. 

Document US-A-51 64832 discloses a CCD-circuit 
having a response curve that has two sensitivity ranges. 
The CCD circuit has a clipping gate that is in a parallel 
configuration on the CCD. In order to obtain a response 
curve, the light integration period is splitted in a first and 
second integration periods. During the first integration 
period, the clipping gate is set to a specific DC voltage 
that removes the signals being generated by a high light 
intensity impinging on the CCD. During the second in- 
tegration period, this limitation is removed. The high sig- 
nals will only add to the result during the second period 
only, low signals will add all the time. 

The collected photocharge during the first period of 
the integration time is limited, during the second period, 
the limitation is removed. This limitation that can be re- 
moved is obtained with a clipping gate that is set to one 
DC voltage during the first period, and to another during 
the second period. This said gate continuously removes 
charge that is in excess. 


The present invention aims to disclose an active or 
passive pixel structure such that with one single pixel, 
a double or multiple linear, voltage-to-light response can 
be obtained. 

The present invention further aims to disclose a 
method of reading out an active or passive. pixel struc- 
ture such that a double or multiple linear voltage-to-light 
response can be obtained in one single image scan. 

Main characteristics of the present invention 

The present invention is related to a method for ob- 


15 


20 


25 


30 


35 


40 


45 Aims of the invention 


50 


11/30/04, EAST Version: 2.0.1.4 


3 


EP0 858 212 A1 


4 


taining a read-out signal of a MOS-based pixel structure 
having at least a photosensitive element with an output 
node and a memory element with a first switch therebe- 
tween. The method comprises the steps of while acquir- 
ing charge carriers on said output node of said photo- 
sensitive element, said charge carriers being converted 
from electromagnetic radiation on the photosensitive el- 
ement, after a first time period creating a first signal, and 
after a second time period, creating a second signal, 
said read-out signal being a combination of at least said 
first and said second signals. 

According to the present invention, there is no lim- 
itation to the amount of collected charges in none of the 
integrated periods. The signal collected during the first 
period is memorized by a switch which shortly closes 
and opens between the period. During the second peri- 
od, there is no electrical contact between the output 
node and the memory element. The switch can thus be 
in the same state in both period of time. After a second 
period, there are thus two charge packets, each ob- 
tained during a different time. In order to read-out, these 
two charge packets are then combined into the read-out 
signal. This combination is done, e.g. by adding or sub- 
tracting this charge packets or by adding or subtracting 
them in the circuitry external to the sensor. 

The method is more particularly performed by the 
following sequence: 

after a first time period, said first switch is opened 
thereby storing a first number of said charge carri- 
ers on said memory element and creating a first sig- 
nal; 

and after a second time period, a second number 
of said charge carriers is stored on said output node 
creating a second signal, said read-out signal being 
a combination of at least said first and said second 
signals. 

It should be understood that the terms "creating" 
and "combining" mean treating the different signals in 
the electronic circuitry according to the basic knowledge 
of the person skilled in the art. 

The photosensitive element can be any element 
such as a photodiode, a photogate, a phototransistor or 
a photoresistor. 

The above-mentioned steps and/or concept can be 
repeated for a number of time periods being larger than 
2. 

According to a preferred embodiment, the method 
further comprises the steps: 

after said second time period, creating a first inter- 
mediate signal from said first signal, 
thereafter opening and closing said first switch 
thereby creating a second intermediate signal, and; 
combining at least said first and said second inter- 
mediate signals in order to obtain said read-out sig- 
nal. 


Preferably, essentially all the charge carriers being 
converted from electromagnetic radiation impinging on 
said photosensitive element during said first time period 
are creating said first signal, except for the normal sat- 
5 uration or anti-blooming of the pixel. 

More preferably, essentially all the charge carriers 
being converted from electromagnetic radiation imping- 
ing on said photosensitive element during said second 
time period are creating said second signal. 
10 According to a first preferred embodiment, the read- 
out signal is an average or a weighed average of at least 
said first and said second signals. 

According to another preferred embodiment, the 
read-out signal is a subtraction of said second signal 
is and said first signal. 

According to a preferred embodiment, a correlated 
double-sampling is performed using an extra-step of 
closing a second switch which is placed in series with 
the photosensitive element in order to have a reset of 
20 said photosensitive element and thereby creating a third 
signal, said read-out signal being a combination of first, 
second and third signals. 

Preferably, in this case the read-out signal is a com- 
bination of the subtraction of third and first signals and 
25 subtraction of third and second signals. 

According to another preferred embodiment, the 
read-out signal can be a combination of the subtraction 
of second and first signals and subtraction of third and 
second signals. 
30 According to another preferred embodiment of the 
present invention, the read-out signal can be a combi- 
nation of the subtraction of second and first signals and 
subtraction of third and first signals. 

The present invention is also related to a MOS or 
3S CMOS based pixel structure comprising at least: 

a photosensitive element for converting electro- 
magnetic radiation into charge carriers and being 
connected to a reset switch and to a supply voltage; 
40 - a memory element being connected to an amplifier, 
and 

a first switch in-between said photosensitive ele- 
ment and said memory element, said first switch be- 
ing opened causing a first number of said charge 
^5 carriers being stored on said memory element. 

The memory element is preferably an analog mem- 
ory element such as a capacitor and the switches 
present in the pixel structure as well as the memory el- 
50 ement are preferably MOS transistors. The capacitor 
can be in fact a parasitic capacitor being formed by the 
interconnect lines in the pixel. 

The present invention is also related to a CMOS im- 
age device having a geometric configuration of pixel, at 
55 least part of the pixels having the structure described 
hereabove. 
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Brief description of the figures 

Figure 1 a and 1 b show a schematic functional rep- 
resentation of the pixel structure 
according to embodiments of the 
present invention. 

Figure 2a and 2b represent the architecture of a 
pixel according to specific em- 
bodiments of the present inven- 
tion. 

Figure 3a represents a typical response of 

the pixel of figure 2. 

Figure 3b represents the different possibil- 

ities for the slope of the response 
varying by the electronic shutter 
ratio. 

Figure 4 represents a possible embodi- 

ment of the pixel structure ac- 
cording to the present invention. 

Figure 5 represents a method of driving 

and reading the pixel. 

Description of preferred embodiments of the 
present invention 

Figure 1 represents a functional pixel structure ac- 
cording to an embodiment of the invention wherein a 
memory element (4) is provided. In this figure 1 , (3) is a 
photosensitive element such as a photoreceptor or pho- 
todiode, which can be reset by a switch (2). The signal 
generated by the photodiode can be periodically sam- 
pled by another switch (1 ) on a capacitor (4). The result- 
ing voltage can then be multiplexed in a classical way 
over circuitry represented by the amplifier A. 

According to one preferred embodiment, such am- 
plifier A is placed within the pixel structure in order to 
have an active pixel. According to another preferred em- 
bodiment, the amplifier A can be placed outside of the 
pixel structure in order to have a passive pixel structure. 

This pixel structure is able to perform the method of 
the invention for obtaining a read-out signal as de- 
scribed and therefore is able to realise a double or mul- 
tiple linear light-to-voltage response in one single pixel. 

Figure 2 represents a specific embodiment of the 
schematic structure as represented in Figure 1 . The pix- 
el therein is a 4T (transistor) integrating active pixel. It 
has the feature of being able to sample through switch 
(21) a signal level intermediate in the integration slope, 
on the node C. Afterwards, both signals (the intermedi- 
ate value and the final integrated value) can be com- 
bined in one read-out signal with high dynamic. In the 
simplest approach, this combination consists of adding 
both values. 

The effective response of such a structure is repre- 
sented in Figure 3a for an active pixel with a double lin- 
ear slope having a first (32) and a second (31 ) part. Ac- 
cording to the present invention and as represented in 
Figure 3b, the slope of the first part (32) can be varied 


by the electronic shutter ratio according to the number 
of rows in the image. For instance, between a factor of 
1 to 250. 

The double slope compresses the high intensity 
5 part of an image, but preserves the low intensity part. It 
has a comparable property as the gamma correction or 
as the logarithmic compression, yet it can be tuned with- 
in a wide range to accommodate various light intensity 
conditions. 

10 A cross-section of a possible implementation in a 
CMOS technology of a pixel structure as represented in 
Figure 1 or 2 is shown in Figure 4 wherein the memory 
element is also realised as a MOS structure (44) (al- 
though it is not necessary to do so); the amplification 

15 and multiplexing beyond are not shown. The metal light 
shield (49) is not necessary, as the operation of the pixel 
structure tolerates some charge collection. Further 
shown in figure 4 is a silicon substrate wherein a pho- 
tosensitive element (43) as a (n ++ )n/p- junction; a first 

20 switch (41 ) and a second switch (42) as metal or poly- 
silicon layers separated from the silicon substrate in fact 
from (the p + surface layer) by a dielectric layer. 

The analog memory element is represented by the 
capacitor component (44) which has a part or parts 

2S which are junctions, or which has connections to other 
circuit elements (in casu transistors) which have junc- 
tions. Junctions are light sensitive, and this light sensi- 
tivity will cause a current flow which will affect the charge 
stored on the capacitor (44). Such memory element or 

30 capacitor (44) can be used for various purposes : spatial 
and temporal filtering, the memorisation of image, etc. 

The above circuit should, in order to operate in the 
best mode, have a stable signal on capacitor (44). Here- 
to, the capacitor and also the interconnections to it 

35 should be shielded from the light, which is straightfor- 
ward by using a metallisation. However, the capacitor 
and/or interconnection elements to it may also collect 
charge that is present in the chip's substrate due to light 
falling on it. Especially, photo charge that is being cre- 

40 ated deep in the substrate can diffuse easily onto ca- 
pacitor (44) or its interconnections, and (dis-)charge 
them. 

If the photo diode (43) or another diode, not part of 
the capacitor (44) is made according to the embodiment 

45 of F igure 4, the wandering charge in the substrate of the 
chip will likely be collected there, and will thus not affect 
the charge on the capacitor (44). 

The present invention is also related to preferred 
methods of reading the signal of a CMOS based pixel 

50 structure in order to obtain a double or multiple linear 
slope for a dynamic response. According to the first pre- 
ferred embodiment, as represented in Figure 5, several 
pulses can be applied to the reset (22) and to the switch 
(21 ) of the pixel structure of figure 2. 

55 On Figure 5, the reset is represented on the first 
line, the sample on the second and the potential level 
seen on the photodiode output node and on the node C 
on the third line. 
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Two integration periods are shown on Figure 5. A 
certain time after the reset pulse, the switch (21) is 
opened for a short while, thus freezing this potential on 
the node (capacitor) C. At the end of the first integration 
period, the switch (21 ) is shortly opened, and the recent 
potential on the photodiode output node is sampled. 

In the present embodiment, a weighted average of 
the recent potential on the photodiode output node and 
of the potential that was frozen on the capacitor C is 
sampled (signal B b°). After reset (closing of switch 22), 
the reset level of the pixel is sampled again (signal "c") 
which might be useful for offset correction, correlated 
double sampling etc. This signal sample ( M b n ) is suffi- 
cient to obtain a double linear response, as this sample 
is in itself the average of the potential on capacitor C 
and on the photodiode, which are the electrical respons- 
es with low and high sensitivity themselves. Difference 
(b-c) is a correlated double sampled version of this sig- 
nal thus removing eventual offset non-uniformity. 

In a more general teaching and without reference 
to the pixel structure of figure 2, in figure 5, the method 
of the invention is schematically shown. 

On Figure 5, the reset is represented on the first 
line, the sample on the second and the potential level 
seen on the photodiode output node and on the node C 
on the third line. A certain time after the reset pulse, the 
sample is opened for a short while, thus freezing this 
potential on capacitor C. 

At the end of the integration period, the memorized 
value on the capacitor C is sampled ("a"), then the sam- 
ple switch is shortly opened, and the recent potential on 
the photodiode output node is sampled fb 8 ). After reset, 
the reset value of the pixel is sampled, which might be 
useful for offset correction, correlated double sampling 
etc. 

Values a and b, or in a correlated double sampling 
configuration, (c-a) and (c-b) are the responses with low 
and high responsivity respectively. Both values can be 
combined externally to the pixel, inside or outside the 
image sensor. The simple way of combination is a linear 
combination, yielding effective response curves as 
shown in figure 3. 

Values a and b, or in a correlated double sampling 
configuration (c-a) and (c-b) are the responses with low 
and high responsivity respectively. Both values can be 
combined externally to the pixel, inside or outside to the 
image sensor. A simple way of combination is a linear 
or even non linear combination, yielding an effective re- 
sponse curve as shown in figure 3a. 

In an embodiment of the present invention, a pixel 
structure is made in a 0.7 nm CMOS technology and 
fabricated at MITEC. The pixel of the invention shows a 
dynamic range of about 1 :20000 to 1 :60000 whereas a 
reference pixel without the characteristics of the inven- 
tion and fabricated in the same technology shows a dy- 
namic range of about 1 :2000 to 1 :3000. 


Claims 

1 . A method for obtaining a read-out signal of a MOS- 
based pixel structure having in a MOS technology 

5 at least a photosensitive element with an output 
node and a memory element with a first switch ther- 
ebetween, the method comprising the steps of while 
acquiring charge carriers on said output node of 
said photosensitive element, said charge carriers 

to being converted from radiation impinging on the 
photosensitive element: 

after a first time period opening said first switch 
thereby storing a first number of charge carriers 
*5 on said memory element and creating a first 

signal; 

- after a second time period, creating a second 
signal from a second number of charge carriers 
being stored on said output node of said pho- 
20 tosensitive element, and 

combining at least said first and said second 
signals in order to obtain said read-out signal. 

2. The method as recited in claim 1, wherein said 
25 steps are repeated for a number of time periods be- 
ing larger than 2. 

3. The method as recited in claim 1 , further comprising 
the steps of: 

30 

after said second time period, creating a first 
intermediate signal from said first signal, 
thereafter opening and closing said first switch 
thereby creating a second intermediate signal; 
35 and 

combining at least said first and said second 
intermediate signals in order to obtain said 
read-out signal. 

40 4. The method as recited in claim 1, wherein all the 
voltages applied on said pixel structure are the 
same during the first and second time periods. 

5. The method as recited in claim 3, wherein the read- 
45 out signal is a weighed average of at least said first 

and said second intermediate signals. 

6. The method as recited in claim 3, wherein the read- 
out signal is a linear combination of said second and 

50 said first intermediate signals. 

7. The method as recited in claim 3, wherein a corre- 
lated double-sampling is performed using an extra- 
step of closing a reset switch which is placed in se- 

55 ries with the photosensitive element in order to have 
a reset of said photosensitive element and thereby 
creating a third signal, said read-out signal being a 
combination of said first, second and third signals. 
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8. The method as recited in claim 7, wherein the read- 
out signal is a combination of the subtraction of third 
and first signals and of the subtraction of third and 
second signals. 

5 

9. The method as recited in claim 7, wherein the read- 
out signal is a combination of the subtraction of sec- 
ond and first signals and of the subtraction of third 
and second signals. 

10 

10. The method as recited in claim 7, wherein the read- 
out signal is a combination of the subtraction of sec- 
ond and first signals and of the subtraction of third 
and first signals. 

15 

11. A MOS-based pixel structure, comprising at least: 

a photosensitive element for converting radia- 
tion into charge carriers, and being connected 
to a voltage with a reset switch therebetween; 20 
a memory element being connected to an am- 
plifier; and 

a first switch in-between said photosensitive el- 
ement and said memory element, said first 
switch being opened causing a first number of 2$ 
said charge carriers being stored on said mem- 
ory element. 


12. A MOS-based pixel structure according to claims 

1 1 , wherein the memory element is an analog mem- 30 
ory such as a capacitor or a parasitic capacitor. 

13. A MOS-based pixel structure according to claim 11, 
wherein both switches are CMOS transistors. 

35 

14. A MOS-based pixel structure according to any one 
of the preceding claims 11 to 13, wherein said am- 
plifier is placed within the pixel structure in order to 
have an active pixel. 

40 

15. A MOS-based pixel structure according to any one 
of the preceding claims 11 to 14, wherein said am- 
plifier is placed outside of the pixel structure in order 
to have a passive pixel structure. 

45 

16. A MOS image sensor having a geometric configu- 
ration of pixels consisting in a structure according 
to any one of the claims 1 2 to 1 5. 

17. Use of the MOS image sensor as recited in claim so 
16 or of the method as recited in claim 11 in a cam- 
era system. 
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